Attorney Docket No.: 1 9880-00 1620US 
Client Reference No.: 247-CIPl 

PATENT APPLICATION 

DEMAND-CAST SYSTEM AND BANDWIDTH MANAGEMENT FOR 
DELIVERY OF INTERACTIVE PROGRAMMING 

Inventors: 

Donald F. Gordon, a citizen of United States, residing at, 
465 Gabilan Street #10 
Los Altos, CA 94022 

Sadik Bayrakeri, a citizen of Turkey, residing at, 
733 Shell Boulevard #104 
Foster City, CA 94404 

Edward A. Ludvig, a citizen of Canada, residing at, 
831 Canyon Road 
Redwood City, CA 94061 

Eugene Gershtein, a citizen of United States, residing at, 
40 IB Cork Harbour Circle 
Redwood Shores, CA 94065 

Jeremy S. Edmonds, a citizen of United States, residing at, 
18923 Sydney Circle 
Castro Valley, CA 94546 

John P. Comito, a citizen of United States, residing at, 
907 Pleasant Hill Road 
Redwood City, CA 94061 

Alfred Li, a citizen of Hong Kong, residing at, . 
161 Positano Circle 
Redwood City, CA 94065 

Assignee: 

DIVA Systems Corporation 
800 Saginaw Drive 
Redwood City, CA 94063 

Entity: Small business concern 



TOWNSEND and TOWNSEND and CREW LLP 
Two Embarcadero Center, 8* Floor 
San Francisco, California 941 1 1 -3834 
Tel: 650-326-2400 



PATENT 

Attorney Docket No.: 1 9880-00 1620US 
Client Reference No.: 247-CIPl 



DEMAlNfD-CAST SYSTEM AND BANDWIDTH MANAGEMENT 
FOR DELFVnERY OF INTERACTIVE PROGRAMMING 

RELATED APPLICATIONS 

The present application is based on co-pending U.S. Provisional Patent 
Application Serial No. 60/178,100, filed January 26, 2000, inventors Sadik Bayrakeri and 
Donald F. Gordon, and entitled "BANDWIDTH MANAGEMENT TECHNIQUES FOR 
DELIVERY OF INTERACTIVE PROGRAM GUIDE." (Attorney Docket No. 19880- 
001600US) The present application is a continuation-in-part of co-pending U.S. Patent 
Application Serial No. 09/524,854, filed March 14, 2000, inventors Sadik Bayrakeri, 
Donald F. Gordon, Edward A. Ludvig, Eugene Gershtein, Jeremy S. Edmonds, John P. 
Comito, and Alfi-ed Li, and entitled "BANDWIDTH MANAGEMENT TECHNIQUES 
FOR DELIVERY OF INTERACTIVE PROGRAM GUIDE." (Attomey Docket No. 
19880-001610US) 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The invention relates to communications systems in general. More 
specifically, the invention relates to video communications systems and interactive 
program guides for video programming, 

2. Description of the Background Art 

Over the past few years, the television industry has seen a transformation 
in a variety of techniques by which its programming is distributed to consumers. Cable 
television systems are doubling or even tripling system bandwidth with the migration to 
hybrid fiber coax (HFC) cable plant. Customers unwilling to subscribe to local cable 
systems have switched in high numbers to direct broadcast satellite (DBS) systems. And, 
a variety of other approaches have been attempted focusing primarily on high bandwidth 
digital technologies, intelligent two way set top terminals, or other methods of trying to 
offer service differentiated fi-om standard cable and over the air broadcast systems. 



With this increase in bandwidth, the number of programming choices has 
also increased. Leveraging off the availabihty of more inteUigent set top terminals, 
several companies such as Starsight Telecast Inc. and TV Guide, Inc. have developed 
elaborate systems for providing an interactive listing of a vast array of channel offerings, 
5 expanded textual information about individual programs, the ability to look forward to 
plan television viewing as much as several weeks in advance, and the option of 
automatically programming a VCR to record a future broadcast of a television program. 

Unfortunately, the existing program guides have several drawbacks. They 
tend to require a significant amount of memory, some of them needing upwards of one 

10 megabyte of memory at the set top terminal (STT). They are very slow to acquire their 

current database of programming information when they are tumed on for the first time or 
are subsequently restarted (e.g., a large database may be downloaded to a STT using only 
a vertical blanking interval (VBI) data insertion technique). Disadvantageously, such 
slow database acquisition may result in out of date database information or, in the case of 

15 a pay per view (PPV) or video on demand (VOD) system, limited scheduling flexibility 
for the information provider. 

The use of compression techniques to reduce the amount of data to be 
transmitted may increase the speed of transmitting program guide information. In several 
communications systems, the data to be transmitted is compressed so that the available 

20 transmission bandwidth is used more efficiently. For example, the Moving Pictures 
Experts Group (MPEG) has promulgated several standards relating to digital data 
delivery systems. The first, known as MPEG-1 refers to ISO/IEC standards 1 1 172 and is 
incorporated herein by reference. The second, known as MPEG-2, refers to ISO/IEC 
standards 13818 and is also incorporated herein by reference. A compressed digital video 

25 system is described in the Advanced Television Systems Committee (ATSC) digital 
television standard document A/53, and is incorporated herein by reference. 

The above-referenced standards describe data processing and manipulation 
techniques that are well suited to the compression and delivery of video, audio and other 
information using fixed or variable rate digital communications systems. In particular, 
30 the above-referenced standards, and other "MPEG-like" standards and techniques, 

compress, illustratively, video information using intra-frame coding techniques (such as 
run-length coding, Huffinan coding and the like) and inter-frame coding techniques (such 
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as forward and backward predictive coding, motion compensation and the like). 
Specifically, in the case of video processing systems, MPEG and MPEG-like video 
processing systems are characterized by prediction-based compression encoding of video 
frames with or without intra- and/or inter-frame motion compensation encoding. 

5 However, the MPEG-1 and MPEG-2 standards have, in some instances, 

very strict elementary stream and transport stream formats, causing usage of extra 
bandwidth for certain applications. For example, if a number of interactive program guide 
(IPG) pages were created as video sequences, only limited number of pages could be 
encoded into a transport stream(s) at a specified bandwidth. 

10 Therefore, it is desirable to provide techniques for more efficiently 

utilizing a limited and finite bandwidth for transmitting program guide video sequences to 
set-top terminals. 

SUMMARY OF THE INVENTION 

The present invention provides a system for more efficient utilization of 
1 5 the finite bandwidth available for distribution of interactive program guide (IPG) video 
sequences. The system utilizes a session manager and a transport stream generator to 
enable a set top terminal to access an entire array of guide pages firom the IPG within the 
constraints imposed by the limited bandwidth available in the distribution network. 

One embodiment of the present invention comprises a system that includes 
20 a session manager (SM) and a transport stream generator (TSG) within a distribution 
control center. The SM monitors and controls usage of demand-cast stream bandwidth 
within the distribution network. The TSG receives information from the SM on each 
demand-cast stream. The information includes which set top terminals, if any, are 
currently acquiring the stream. The TSG uses the information to control the demand-cast 
25 streams multiplexed into the transport stream for distribution to the set top terrninals, 

BRIEF DESCRIPTION OF THE DRAWINGS 

The teachings of the present invention can be readily understood by 
considering the following detailed description in conjunction with the accompanying 
drawings. 
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Figure 1 depicts an illustrative communications network 1 00 for 
distributing video sequences to a plurality of terminals in accordance with an embodiment 
of the present invention. 

Figures 2-6 depicts various methods and topologies for demand-casting 
5 interactive program guide (IPG) pages in accordance with embodiments of the present 
invention. 

Figure 2A is a flow chart showing a first push method 200 for demand- 
casting interactive program guide (IPG) pages in accordance with an embodiment of the 
present invention. 

10 Figure 2B depicts a first push topology 250 for demand-casting IPG pages 

in accordance with an embodiment of the present invention. 

Figure 3 A is a flow chart showing a second push method 300 for demand- 
casting IPG pages in accordance with an embodiment of the present invention. 

Figure 3B depicts a second push topology 350 for demand-casting IPG 
15 pages in accordance with an embodiment of the present invention. 

Figure 4A is a flow chart showing a first pull method 400 for demand- 
casting IPG pages in accordance with an embodiment of the present invention. 

Figure 4B depicts a first pull topology 450 for demand-casting IPG pages 
in accordance with an embodiment of the present invention. 

20 Figure 5A is a flow chart showing a second pull method 500 for demand- 

casting IPG pages in accordance with an embodiment of the present invention. 

Figure 5B depicts a second pull topology 550 for demand-casting IPG 
pages in accordance with an embodiment of the present invention. 

Figure 6A is a flow chart showing a third pull method 600 for demand- 
25 casting of IPG pages in accordance with an embodiment of the present invention. 

Figure 6B depicts a third pull topology 650 for demand-casting of IPG 
pages in accordance with an embodiment of the present invention. 
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Figure 6C is a flow chart showing a method 660 of terminating (or 
continuing) demand-casts in accordance with the third pull method 600. 

Figure 7 depicts a two-way system 700 for efficient delivery of demand- 
cast video sequences in accordance with an embodiment of the present invention. 

5 Figure 8 depicts an example of a set of IPG pages for constant broadcast 

and other IPG pages for demand-cast in accordance with a preferred embodiment of the 
present invention. 

Figure 9 depicts an example of one fi-ame taken fi"om a video sequence that 
can be encoded using the present invention. 

10 Figure 10 depicts a first implementational architecture 1000 for managing 

delivery of video sequences of an interactive program guide in accordance with an 
embodiment of the present invention. 

Figure 1 1 depicts a second implementational architecture 1 100 for 
managing delivery of video sequences of an interactive program guide in accordance with 
15 an embodiment of the present invention. 

Figure 12 depicts a third implementational architecture 1200 for managing 
delivery of video sequences of an interactive program guide in accordance with an 
embodiment of the present invention. 

Figure 13 depicts a fourth implementational architecture 1300 for 
20 managing delivery of video sequences of an interactive program guide in accordance with 
an embodiment of the present invention. 

\^ 

Figure 14 depicts an embodiment for the content of the demand-cast index 

table. 

Figure 1 5 depicts one embodiment for the contents of the messages sent 
25 fi-om the terminal 706 to the SM 702. 

Figure 16 depicts one embodiment for the contents of the messages sent 
fi-om the SM 702 to the TSG 704. 
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Figure 17 depicts one embodiment for the contents of the 
acknowledgement messages sent by the TSG 704 back to the SM 702. 

Figure 18 depicts an example showing status of active demand-cast 
streams in an IPG multiplex. 

5 Figure 19 illustrates the various scenarios for activation of a demand-cast 

stream. 

Figure 20 illustrates an overall process by which a released stream may be 
converted to a passive stream. 

DESCRIPTION OF THE SPECIFIC EMBODIMENTS 

10 

1. ILLUSTRATIVE COMMUNICATIONS NETWORK 

Figiu-e 1 depicts an illustrative communications network 100 for 
distributing video sequences to a plurality of terminals in . accordance with an embodiment 
of the present invention. The illustrative network 100 comprises a cable distribution 
15 network, but other types of distribution networks may also be used within the spirit and 
scope of the present invention. 

The illustrative network 100 includes one or more head-ends 102, one or 
more centers for local neighborhood equipment 104, a plurality of distribution nodes 106, 
and a plurality of subscriber stations 108. The local neighborhood equipment (LNE) 104 
20 may be located, for example, at remote hubs of a cable distribution network. The end- 
user terminals 108 may comprise, for example, interactive set-top terminals (STT) or 
other devices with similar interactive functionalities. 

IL EXAMPLE METHODS AND TOPOLOGIES 

In the present application, the demand-cast term is used to refer to the 
25 process of managing and delivering content to one or more users depending on user 

demand for the content. Figures 2-6 depicts various methods and topologies for demand- 
casting interactive program guide (IPG) pages. The various methods/topologies are given 
for purposes of edification and are not meant to limit the scope of the present invention. 
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Figure 2A is a flow chart showing a first push method 200 for demand- 
casting interactive program guide (IPG) pages in accordance with an embodiment of the 
present invention. As described below, the method 200 includes four steps. 

In a first step 202, a first set of EPG pages to be broadcast are 
5 predetermined. The first set of IPG pages may comprise video sequences, for example, 
for a current time period. For instance, if the current time is 1 :07 pm, then the current 
time period may include programming fi-om 1 :00 pm to 2:30 pm, assuming a 90 minute 
time period. 

In a second step 204, a second set of IPG pages to be broadcast are 
^ 10 predetermined. The second set of IPG pages may comprise video sequences, for 

example, for a prime time period. Such a prime time period is a time period during which 
yj a large number of viewers typically watch TV programming. For example, the prime 

f^- time period may include programming firom 6:00 pm to 9:00 pm. 

In a third step 206, bandwidth to broadcast the first and second sets of IPG 
P 15 pages is allocated in the distribution system for that purpose. For example, as described 
below in more detail, a bandwidth manager (BWM) within a head-end 102 and/or local 
neighborhood equipment 104 allocates within the in-band network the necessary 
□ bandwidth to broadcast the first and second sets of IPG pages to the set-top terminals 

(STT) 108. If the first and second sets overlap, then only the non-redundant video 
20 sequences need to be broadcast and so only enough bandwidth to broadcast the non- 
redundant video sequences needs to be allocated. Such a situation may happen, for 
example, when the current time period is within prime time. 

In a fourth step 208, the IPG pages of the first and second sets are 
broadcast to set-top terminals (STT) 1 08 within the broadcast range. The broadcast range 
25 may comprise all terminals 108 downstream fi"om the head-end 102 or local 

neighborhood equipment 104. Only the non-redundant content needs to be broadcast. 
The broadcast is performed within the allocated in-band bandwidth. 

Figure 2B depicts a first push topology 250 for demand-casting IPG pages 
in accordance with an embodiment of the present invention. The topology 250 relates to 
30 the push method 200 of Fig. 2 A. As shown in Fig. 2B, the IPG pages are transmitted 
fi-om the head-end (HE) 102 or local neighborhood equipment (LNE) 104 dovrastream 
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within the illustrative communications network 100. As shown in Fig. 2B, the broadcast 
is pushed from the HE 102 or LNE 104 to the distribution nodes 106 and finally to the 
multitude of set-top terminals 108. 

Figure 3 A is a flow chart showing a second push method 300 for demand- 
5 casting IPG pages in accordance with an embodiment of the present invention. As 
described below, the method 300 includes three steps. 

In a first step 302, an IPG page is selected to be narrowcast to a group 352 
of terminals 108. For example, the group of terminals may be a group comprising a high 
concentration of users with a particular ethnicity or special interest, and the IPG page 

10 selected may comprise programming targeted to that ethnic group or special interest 
group. As another example, the group of terminals may comprise terminals 108 in a 
school campus or business, and the IPG page selected may comprise class instruction or 
other targeted material. The group 352 may include terminals 108 in one geographic area 
or terminals 1 08 dispersed among different geographic areas but linked, for example, via 

15 a network group address. 

In a second step 304, bandwidth to narrowcast the selected IPG pages is 
allocated in the distribution system for that purpose. For example, as described below in 
more detail, a bandwidth manager (BWM) within a head-end 102 and/or local 
neighborhood equipment 104 allocates within the in-band network the necessary 
20 bandwidth to narrowcast the selected ERG page to the group 352 of terminals 108. If the 
requested IPG page is already being broadcast per Figs. 2A and 2B, then no additional 
bandwidth for a narrowcast need be allocated. 

In a third step 306, the selected IPG page is narrowcast to the group of 
terminals 108. The narrowcast need only be received by terminals 108 within the group 
25 352 and does not need to be received by other STTs 108. The narrowcast is sent 

downstream from the head-end 102 or local neighborhood equipment 104 to the group 
352 of terminals 108. The narrowcast is performed within the allocated in-band 
bandwidth. If the requested IPG page is already being broadcast per Figs. 2A and 2B, 
then the narrowcast need not be performed. 

30 Figure 3B depicts a second push topology 350 for demand-casting IPG 

pages in accordance with an embodiment of the present invention. The topology 350 
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relates to the push method 300 of Fig. 3 A. As shown in Fig. 3B, the IPG page is 
transmitted from the head-end (HE) 102 or local neighborhood equipment (LNE) 104 
downstream within the illustrative communications network 100. As shown in Fig. 3B, 
the narrowcast is pushed from the HE 1 02 or LNE 1 04 to one or more distribution nodes 
5 106 and finally to the terminals 108 within the group 352. 

Figure 4A is a flow chart showing a first pull method 400 for demand- 
casting IPG pages in accordance with an embodiment of the present invention. As 
described below, the method 400 includes three steps. 

In a first step 402, a request for an IPG page is received from a STT 108. 
10 The request is transmitted upstream from the STT 108 to the HE 102 or LNE 104 by way 
of the communications network 100. The upstream transmission may be done via an out- 
yj of-band network. Alternatively, the upstream transmission may be done via an in-band 

Tfl network. Such a request may comprise, for example, a look ahead request where a user 

wishes to view programming for a time period ahead of the current time period. For a 
= 15 system where a set or sets of IPG pages are already being broadcast per Figs. 2 A and 2B, 
ni the STT 1 08 may first check to see whether or not the requested IPG page is already 

being broadcast before transmitting the request upstream. 

2 In a second step 404, bandwidth to pointcast the requested IPG page is 

allocated in the distribution system for that purpose. For example, as described in more 

20 detail below, a bandwidth manager (BWM) within a head-end 102 and/or local 

neighborhood equipment 104 may allocate within the in-band network the necessary 
bandwidth to pointcast the requested IPG page to the requesting STT 108. Such 
allocation is performed if sufficient system resources are available to establish such a 
session. Moreover, if the requested IPG page is already being broadcast per Figs. 2A and 

25 2B, then no additional bandwidth for a pointcast need be allocated. 

In a third step 406, the requested IPG page is pointcast to the requesting 
set-top terminal (STT) 108. The pointcast need only be received by the requesting STT 
108 and does not need to be received by other STTs 108. The pointcast is sent 
downstream from the head-end 102 or local neighborhood equipment 104 to the 
30 requesting STT 108. The pointcast is performed within the allocated in-band bandwidth. 
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If the requested IPG page is already being broadcast per Figs. 2A and 2B, then the 
PointCast need not be performed. 

Figure 4B depicts a first pull topology 450 for demand-casting IPG pages 
in accordance with an embodiment of the present invention. The topology 450 relates to 
5 the pull method 400 of Fig. 4A. As shown in Fig. 4B, the request is transmitted upstream 
from the requesting STT 108 to the HE 102 or LNE 104 via illustrative communications 
network 100. Subsequently, the requested IPG page is pointcast downstream from the 
HE 102 or LNE 104 to the requesting STT 108 via the network 100. 

Figure 5A is a flow chart showing a second pull method 500 for demand- 
1 0 casting IPG pages in accordance with an embodiment of the present invention. As 
described below, the method 500 includes three steps. 

In a first step 502, a request for an IPG page is received from a requesting 
STT 552. The request is transmitted upstream from the requesting STT 552 to the HE 
102 or LNE 104 by way of the communications network 100. The upstream trarismission 

15 may be done via an out-of-band network. Alternatively, the upstream transmission may 
be done via an in-band network. Such a request may comprise, for example, a look ahead 
request where a user wishes to view available special interest programming for a time 
period ahead of the current time period. For a system where a set or sets of IPG pages are 
already being broadcast per Figs. 2A and 2B, the requesting STT 552 may first check to 

20 see whether or not the requested IPG page is already being broadcast before transmitting 
the request upstream. 

In a second step 504, bandwidth to narrowcast the requested IPG page is 
allocated in the distribution system for that purpose. For example, as described below in 
relation to Figs. 7 and 8, a bandwidth manager (BWM) within a head-end 102 and/or 

25 local neighborhood equipment 104 may allocate within the in-band network the necessary 
bandwidth to narrowcast the requested IPG page to a group 554 of terminals which 
includes the requesting STT 552. Such allocation is performed if sufficient system 
resources are available to establish such a session. If the requested IPG page is already 
being broadcast per Figs. 2A and 2B, then no additional bandwidth for a pointcast need 

30 be allocated. The group 554 may include terminals 108 in one geographic area or 
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terminals 108 dispersed among different geographic areas but linked, for example, via a 
network group address. 

In a third step 506, the requested IPG page is narrowcast to the group 554 
of terminals 108. The narrowcast need only be received by terminals 108 within the group 
5 554 and does not need to be received by other STTs 108. The narrowcast is sent 

downstream from the head-end 102 or local neighborhood equipment 104 to the group 
554 of terminals 108. The narrowcast is performed within the allocated in-band 
bandwidth. If the requested IPG page is already being broadcast per Figs. 2 A and 2B, 
then the narrowcast need not be performed. 

10 Figure 5B depicts a second pull topology 550 for demand-casting IPG 

pages in accordance with an embodiment of the present invention. The topology 550 
relates to the pull method 500 of Fig. 5A. As shown in Fig. 5B, the request is transmitted 
upstream from the requesting STT 552 to the HE 102 or LNE 104 via illustrative 
communications network 100. Subsequently, the requested IPG page is narrowcast 

15 downstream from the HE 102 or LNE 104 to the group 554 which includes the requesting 
STT 108 via the network 100. 

Figure 6A is a flow chart showing a third pull method 600 for demand- 
casting of IPG pages in accordance with an embodiment of the present invention. As 
described below, the method 600 includes five steps. 

20 In a first step 602, a request for an IPG page is received from a first STT 

652. The request is transmitted upstream from the first STT 652 to the HE 102 or LNE 
104 by way of the communications network 100. The upstream transmission may be 
done via an out-of-band network. Alternatively, the upstream transmission may be done 
via an in-band network. Such a request may comprise, for example, a look ahead request 

25 where a user wishes to view programming for a time period ahead of the current time 
period. For a system where a set or sets of IPG pages are already being broadcast per 
Figs. 2A and 2B, the first STT 652 may first check to see whether or not the requested 
IPG page is already being broadcast before transmitting the request upstream. 

In a second step 604, a stream 656 assigned to pointcast the requested IPG 
30 page may be allocated in the distribution system for that purpose. Such allocation is 
performed if sufficient system resources are available to establish such a session. For 
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example, as described below in more detail, a bandwidth manager (BWM) within a head- 
end 102 and/or local neighborhood equipment 104 may determine that sufficient 
resources are available to assign the stream 656 to pointcast the requested IPG page to the 
\ first STT 652. The stream assignment may be made, for example, by assigning a 
5 particular value to the program identifier (PID) for the stream 656. If the requested IPG 
page is already being broadcast per Figs, 2 A and 2B, then the stream assignment need not 
be made. 

In a third step 606, the requested IPG page is pointcast to the first STT 652 
via the assigned stream 656. This may be done by transmitting packets that are identified 
10 by the particular PID value and contain the video sequence of the requested IPG page. 

The pointcast need only be received by the first STT 652 and does not need to be received 
by other STTs 108. The pointcast is sent downstream from the head-end 102 or local 
neighborhood equipment 104 to the first STT 652. If the requested IPG page is already 
being broadcast per Figs. 2A and 2B, then the pointcast need not be performed. 

15 In a fourth step 608, a request for an IPG page is received from a second 

STT 654, where the IPG page requested is the same IPG page as the one requested by the 
first STT 652 in the first step 602. Like the first request, this second request is 
transmitted upstream from the second STT 654 to the HE 102 or LNE 104 by way of the 
communications network 100 via either an out-of-band network or via an in-band 

20 network. The second STT 654 may be either in the same geographic area as the first STT 
652, or the second STT 654 may be in a different geographic area as the first STT 652. 

Either way, in a fifth step 610, the identifier (e.g., PID value) for the 
stream 656 is transmitted from the HE 102 or LNE 104 to the second STT 654. This 
enables the next step 612 to occur without use of additional PIDs or additional network 
25 bandwidth. 

Finally, in a sixth step 612, the second STT 654 receives the requested IPG 
page via the same stream 656 as that which delivers the IPG page to the first STT 652. 
This may be done, for example, by setting the second STT 654 to decode and present 
packets that are identified by the particular PID value for the stream 656. Such packets 
30 are the ones which contain the video sequence of the requested IPG page. In this manner. 
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"sharing" of the stream 656 occurs, changing the previously "single" pointcast to a 
"double" PointCast. 

Similarly, additional terminals 108 may "share" the pointcast by 
requesting the same IPG page and receiving it via the same stream 656. In this way, any 
5 number of terminals 108 may share the pointcast. This results in more efficient use of 
limited bandwidth. 

Figure 6B depicts a third pull topology 650 for demand-casting of IPG 
pages in accordance with an embodiment of the present invention. The topology 650 
relates to the pointcast "sharing" method 600 of Fig. 6A. As shown in Fig. 6B, a request 

10 is transmitted upstream from the first STT 652 to the HE 102 or LNE 104 via illustrative 
communications network 100. In response, the requested IPG page is pointcast by way of 
a stream 656 from the HE 102 or LNE 104 to the first STT 652. Next, a second request 
for the same IPG page is transmitted upstream from the second STT 654 to the HE 102 or 
LNE 104 via the network 100. In response, the identifier for the stream 656 is transmitted 

15 from the HE 102 or LNE 104 to the second STT 654. Subsequently, the second STT 654 
uses the identifier to receive the IPG page from that same stream 656. 

Figure 6C is a flow chart showing a method 660 of terminating (or 
continuing) demand-casts in accordance with the third pull method 600. As described 
below, the rnethod 660 includes five steps. 

20 In a first step 662, an STT finishes viewing a stream which transmits an 

IPG page. In the example discussed above with respect to Figs. 6A and 6B, the STT may 
be either the first STT 652 or the second STT 654. In general, the STT may be any of 
multiple terminals which are sharing the stream, or the STT may be the last terminal to be 
viewing a stream which was previously shared. 

25 In a second step 664, the HE 102 or LNE 1 04 is notified that the STT has 

finished viewing the stream. Such a notification occurs by the STT sending a 
communication upstream to the HE 102 or LNE 104 by way of an out-of-band or in-band 
network. 

In a third step 666, a determination is made as to whether or not that 
30 stream is still being viewed by one or more STTs. As described in more detail below, this 
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determination is done within the HE 1 02 or LNE 1 04 and may be done by a bandwidth 
manager in conjunction with a session manager. 

In a fourth step 668, if one or more STTs are still viewing that stream, then 
transmission of the stream by the HE 102 or LNE 104 continues. Such transmission is 
typically performed by an in-band delivery system. 

Finally, in a fifth step 670, if no more STTs are still viewing that stream, 
then the stream is "tom down" so that it is no longer transmitted and no longer takes up 
network bandwidth. The tom down stream is made available for reassignment to reuse 
the bandwidth to transmit a different pointcast, narrowcast, or broadcast. 

III. DEMAND-CAST SYSTEM 

1. Guide Page Usage Frequency Distribution 

Prerequisite assumptions need to be made regarding the usage frequency 
distribution of guide pages. Certain pages in the guide page matrix, such as those in the 
current time slot and adjacent time slots (near look-ahead) are likely to be accessed 
frequently by STT users. Similarly, other guide pages, as in the case of "far look-ahead" 
pages, are likely to be accessed less frequently. This characteristic, inherent in guide 
page usage, lends the IPG well to a demand-cast model described in this document. 
Access to all the guide pages in the guide page matrix can be made possible by sending in 
the transport a combination of constantly broadcast guide pages for those pages that are 
most firequently accessed, and temporarily broadcast or demand-cast guide pages for 
those less frequently accessed. The technique consists in sending current and near look- 
ahead pages in broadcast fashion and sending far look-ahead pages in demand-cast 
fashion. 

2. Demand-cast Overview 

A demand-cast IPG system is a two-way system requiring communication 
between STT users on the cable network and the head-end via a back-channel. Demand- 
cast pages are inserted in the transport stream for temporary broadcast based on access 
demand generated by STT users on the cable network. When a request for a guide page is 
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made by a particular STT, two things can happen. If the page is aheady in the IPG 
broadcast, the STT simply acquires the corresponding stream. If the page is not in the 
broadcast, the STT requests from the head-end that the corresponding stream be inserted 
in the IPG multiplex. The head-end replaces the least frequently accessed and not 
5 currently accessed stream in the IPG multiplex with the newly requested page. When a 
STT no longer accesses a guide page, it informs the head-end that it has released it. When 
accessing a demand-cast page, the IPG STT application also times-out following a certain 
delay of inactivity (i.e. 2 minutes) on the part of the user. In this case it also informs the 
head-end that it has released the page. Informing the head-end when demand-cast pages 

10 become released ensures that non-accessed demand-cast pages become available for 

substitution. When a STT requests that a new demand-cast page be inserted into the IPG 
multiplex, if there is no slot available in the IPG multiplex, the head-end refuses to insert 
a newly requested guide page resulting in a blockage. All statistical systems are 
susceptible to blockage if loaded with too many users or in the case of rare chaotic 

15 episodes. The advantage of the demand-cast model is that if a particular page is 

susceptible to intensive access, such as in the case of a page listing a major sports event, it 
only needs to be inserted once into the transport stream. It is readily accessible by 
multiple STTs without consuming additional bandwidth. 

20 3. Latency in Broadcast vs. Demand-cast 

Access to guide pages with low latency is an important feature in the IPG. 
Constantly broadcast pages offer the lowest latency access, whereas demand-cast pages 
may be delayed if not yet in the transport stream. Frequently accessed pages, such as 
25 those in the current time slot and near look- ahead time slots, and perhaps prime-time slots 
need to be broadcast constantly so as to remain accessible with the minimum of latency. 
Less frequently accessed far look-ahead pages can be demand-cast. 

4. System Description 

30 Figure 7 depicts a two-way system 700 for efficient delivery of demand- 

cast video sequences in accordance with an embodiment of the present invention. The 
system 700 includes a session manager (SM) 702 and a transport stream generator (TSG) 
704. 
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Both the SM 702 and the TSG 704 may be, for example, co-located at a 
distribution center. The distribution center may comprise, for example, a headend 102 in 
the illustrative distribution system 100. Altematively, the SM 702 and the TSG 704 may 
be at different locations. For example, the SM 702 may be at a headend 1 02, and the 
5 TSG 704 may be at local neighborhood equipment 1 04 in the illustrative distribution 
system 100. 

Both the SM 702 and the TSG 704 are coupled to a plurality of terminals 
706 via a distribution network. The distribution network may comprise, for example, the 
cable distribution network 100 illustrated in Fig. 1. In that example, the terminals 706 
10 would comprise set-top terminals 108 or the equivalent functionality integrated into a 
computer system or advanced television. Altematively, for example, the distribution 
network may comprise a satellite communications system or another type of 
communications system (telephonic, wireless, etc.). 

One terminal 706 and its links to the SM 702 and the TSG 704 are 
15 illustrated in Fig. 10. In the particular embodiment shovm in Fig. 10, the terminal 706 
receives in-band communications from the TSG 704 and sends out-of-band (OOB) 
communications to the SM 702. In an alternative embodiment, the communications to 
the SM 702 may comprise upstream in-band communications. 

The session manager (SM) 702 may comprise, in one embodiment, a 
20 computer system residing at a cable headend 102. The computer system may comprise, 
for example, a computer server running a version of the UNIX (or altematively Windows) 
operating system. The computer system may receive out-of-band commmunications from 
the terminals 706 by way of a connection to the network controller. For example, the 
connection may comprise an Ethemet connection, and the network controller may 
25 comprise one from General Instruments (now part of Motorola) or another supplier. The 
computer system also communicates with and controls the transport stream generator 704 
by way of a network connection such as an Ethemet cormection. 

The SM 702 manages delivery of the IPG to terminals 706 on multiple 
cable nodes each served by a separate IPG multiplexed transport stream generated at a 
30 TSG 704. The SM 702 also monitors demand-cast stream usage by the terminals 706. It 
tracks IPG demand-cast streams that are acquired by at least one terminal 706 by 
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maintaining a dynamic list of temiinals 706 using each stream. This is done for each IPG 
multiplexed transport stream managed by the SM 702. The SM 702 also accepts 
messages from terminals 706 indicating that they have acquired, released, or requested 
demand-cast streams. A terminal 706 that has acquired a demand-cast stream is 
5 registered to the stream, and a terminal 706 that has released a demand-cast stream is 
removed from the registry for the stream. The SM 702 informs the corresponding TSG 
704 once there is no logner any terminals 706 registered to a particular demand-cast 
stream. It also informs the TSG 704 when a terminal 706 requests a demand-cast stream. 
In one embodiment, the SM 702 may time-out acquisition of a stream by any terminal 
10 706 if the terminal 706 has not released the stream within a period of time (for example, a 
few minutes). The time-out may be implemented by removing the particular terminal 706 
from the registry for the stream. 

The transport stream generator (TSG) 704 may comprise, in one 
embodiment, a computer system residing at a cable headend 102. The computer system 

1 5 may comprise, for example, a computer server running a version of the Windows (or 
alternatively UNIX) operating system. Alternatively, the TSG 704 may be located 
separately from the SM 702, for example, at local neighborhood equipment 104. Each 
TSG 704 is coupled to a SM 702, for example, via an Ethernet network. The TSG 704 
may generate one or more IPG multiplexed transport stream, each broadcast to a 

20 respective node in the distribution system. 

In one embodiment, the IPG multiplexed transport, stream comprises a 
MPEG transport stream. In this case, the TSG 704 may communicate with the terminals 
706 by way of tables in the private section of the MPEG transport stream. Such a table 
may include a list of available demand-cast streams, along with the address of the source 
25 TSG 704 and information to identify the particular IPG multiplexed transport stream to 
which the table belongs. 

The TSG 704 manages each IPG multiplexed transport stream which it 
generates. The TSG 704 receives information from the SM 702 indicating whether each 
demand-cast stream being served is currently being acquired by any terminal 706 or not. 
30 In other words, the TSG 704 is informed by the SM 702 when there is no longer any 
terminals 706 acquiring a demand-cast stream. 
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In one embodiment, the TSG 704 maintains a status for each variable 



demand-cast stream being served. The status is adjusted upon receipt by the TSG 704 of 
certain messages from the SM 702. The basic states for the status comprise an "acquired" 
state which denotes that the demand-cast stream is in use by one or more terminals 706, 
5 and a "released" state which denotes that that the demand-cast stream is not in use by any 
terminal 706. The TSG 704 keeps serving "acquired" demand-cast streams by 
multiplexing them into appropriate transport streams and replaces "released" demand-cast 
streams with new demand-cast streams upon receipt of a request message from the SM 
702. Li a preferred embodiment, the TSG 704 also keeps track of the order in which the 
10 streams are released, so that the oldest released stream may be used as the preferred 
candidate for replacement. 

If all the demand-cast streams in a particular IPG multiplexed transport 
stream are "acquired," then a new stream cannot be inserted, and so the TSG 704 reftises 
the request. In such a case, a message indicating such a reftisal may be sent to the SM 
15 702 and/or the requesting terminal 706. 



for use by a service subscriber. The STT may comprise an embedded system which 
includes a tuner, a demultiplexer, and a decoder. The STT drives the subscriber's display 
unit or TV set, and it may be connected to the TSG 704 by way of a RF feed from a cable 
20 distribution network. The IPG content may be received from a particular IPG 

multiplexed transport stream on a specific QAM carrier signal. In one embodiment, the 
IPG multiplexed transport stream may comprise an ensemble of elementary MPEG video 
streams, each representing a portion of the guide. 



25 application which is resident at the terminal 706. The IPG client application is 
responsible for presenting the IPG to the subscriber. The IPG client application 
demultiplexes and decodes IPG pages requested by the user. If a requested page is 
already being received via the IPG multiplexed transport stream, then the IPG client 
application acquires the stream immediately and sends a message to the SM 702 that it 

30 has acquired the stream. If the requested page is not in the IPG multiplexed transport 
stream, then the IPG client application sends a request message to the SM 702. 
Subsequently, the IPG client application acquires the stream once it is received. In 



In one embodiment, the terminal 706 comprises a set-top terminal (STT) 



In a preferred embodiment, the terminal 706 includes IPG client software 
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addition, when a stream is no longer being acquired, the IPG client application sends a 
release message to the SM 702. In one embodiment, if there is no remote control or other 
activity by the user for a period of time (for example, a few minutes), then the IPG client 
application times-out the acquisition. The time-out may be accomplished, for example, 
5 by sending a release message to the SM 702 and acquiring a broadcast stream instead. 

5. Description Per Major Module 

The demand-cast system consists of three major subsystems: the set top 
10 terminal (STT); the session manager (SM); and the transport stream generator (TSG.) A 
description of each subsystem follows. 

A. STT (Set-Top Terminal) 

15 The set top terminal is the end-user or cable service subscriber 

tuner/demultiplexer/decoder and embedded system. Currently, the STT used in initial 
pilot deployments is the General Instruments DCT-2000. It is connected to the cable 
operator RF feed. It drives the subscribers display unit or TV set. The IPG content is in 
the IPG transport stream (or multiplex) located on a specific QAM carrier. The IPG 

20 multiplex contains an ensemble of elementary MPEG video streams each representing 
portions of the guide. Some of these streams are guide grid pages. The STT receives 
messages from the head-end via tables in the private section of the IPG transport stream 
(in-band messaging.) The STT sends messages to the head-end via the out-of-band return 
path. 

25 

The IPG Application is the set top terminal resident program responsible 
for presenting the DIVA Interactive Program Guide to the subscriber. The IPG 
application demultiplexes and decodes IPG pages requested by the user. If a particular 
page is in the IPG transport stream, the STT acquires the stream immediately and informs 
30 the SM that it has requested it. If the page is not in the multiplex, the STT also sends a 
message to the SM that it has requested it. Then it acquires the stream once it's in the 
multiplex. When the STT no longer is acquiring a guide stream, it informs the SM that it 
has released it. 
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If the STT is on a demand-cast stream for more than 2minutes without any 
remote control activity, it times-out. It acquires a broadcast stream instead and informs 
the SM that it has released the demand-cast stream. 

5 B. SM (Session Manager) 

The session manager is a computer residing at the cable head-end. 
Currently, the SM is a SPARC Station running Solaris. It is connected via Ethemet to the 
server side of the General Instruments network controller (NC) and is the receiver for OB 
10 retum path messages originating from STTs. The SM can handle STTs on multiple cable 
nodes each served by a separate IPG multiplex. The SM communicates and controls the 
TSGs via Ethemet. The TSGs generate the IPG transport streams. 

The SM manages one or multiple cable networks and monitors demand- 
1 5 cast stream usage. It tracks IPG demand-cast streams that are acquired by at least one 
STT maintaining a dynamic list of STTs that are using them. This is done for each 
multiplex managed by the SM. The SM accepts messages from STTs indicating that they 
have requested or released demand-cast streams. A STT that has acquired a demand-cast 
stream is registered to the stream and a STT that has released a demand-cast stream is 
20 removed from the streams registry. The SM informs the TSG once there are no longer 
any STTs on a particular demand-cast stream. It also informs the TSG when a STT 
requests a demand-cast stream. 

The SM times-out any STT from a demand-cast stream if the box has not 
25 released the stream within a few minutes. It does this by removing it from the demand- 
cast stream's registry. 

C. TSG (Transport Stream Generator) 

30 The transport stream generator is a computer residing at the cable head- 

end. Currently, the TSG is a PCI WinNT system. It is connected via Ethemet to the SM 
controlling it. The TSG produces one or more IPG transport streams each broadcast to 
their respective nodes. The TSG communicates with the STTs by way of tables in the 
private section of the IPG transport streams. The table contains the list of available 
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demand-cast streams along with the EP address of the source TSG (its IP address) and the 
channel number of the IPG multiplex, (which multiplex it is in the TSG) 

The TSG manages the transport stream for each IPG multiplex it generates. 
It receives information from the SM on each demand-cast stream indicating whether the 
stream is currently acquired by any STT or released by all STTs. The TSG is informed 
by the SM when there is no longer any STT on a demand-cast stream. The TSG is 
informed by the SM when a STT requests a demand-cast stream. The TSG maintains 
status for all the demand-cast streams in each multiplex. It adjusts the status for each 
stream for which it receives a message from the SM. The basic status is 'acquired' for 
streams in use by one or more STTs or 'released' for streams that are not in use by any 
STT. The TSG keeps 'acquired' streams in its multiplexes and replaces 'released' 
streams with new demand-cast streams upon request. It also keeps track of which are the 
few oldest 'released' stream. The best candidate for replacement is always the oldest 
'released' stream. If all the demand-cast streams in a multiplex are 'acquired' then a new 
stream can not be inserted and the TSG refuses the request. 

V. EXAMPLE OF INTERACTIVE PROGRAM GUIDE 

An embodiment of an interactive program guide in accordance with the 
present invention is described below. The embodiment is described for purposes of 
illustration and is not meant to limit the scope of the present invention. 

Figure 8 depicts an example of a set of IPG pages for constant broadcast 
and other IPG pages for variable demand-cast in accordance with a preferred embodiment 
of the present invention. In the example shown in Fig. 8, 40 IPG pages are constantly 
broadcast and up to 30 IPG pages may be variably demand-cast. There are 10 guide 
pages per time slot, and the constant broadcast includes 10 guide pages for the current 
timeslot and 30 guide pages for the next three hourly timeslots. The variably demand- 
cast pages may be any pages within the guide page matrix that are not currently being 
broadcast. 

In such a system, when a request for a guide page is made by a particular 
terminal, either of two scenarios can occur. First, if the page is already in the IPG 
broadcast, then the terminal simply acquires the stream with the page from the broadcast. 
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Second, if the page is not in the broadcast, then the terminal transmits a request for the 
page to the head-end. The head-end may then fulfill the request by replacing the least 
firequently accessed and not currently accessed stream being transmitted downstrem with 
a stream containing the requested page. 

5 Subsequently, the terminal will end its access of the guide page. This may 

occur because the user has instructed the terminal to view a different page. Alternatively, 
this may occur because of a time-out due to inactivity over a period of time (for example, 
2 minutes). In any case, when the terminal is no longer accessing the guide page, then the 
terminal transmits a message to the head-end which indicates that the terminal has 
10 released the corresponding stream. Informing the head-end when varibly demand-cast 
pages become released ensures that non-accessed demand-cast pages become available 
for substitution as described above. 

One advantage of the preferred embodiment of the present invention is 
that, if a particular page is intensively accessed (such as a page listing a major sports 
15 event), then the system needs to insert the particular page only once into the transport 
stream. Once inserted, the page is readily accessible by multiple terminals without 
consuming additional bandwidth. Other systems would be more susceptible to blockage. 
Blockage would occur, for example, when a newly requested page cannot be inserted into 
the transport stream because there is no available bandwidth within the transport stream. 

20 An IPG delivery system in accordance with a preferred embodiment of the 

present invention is a two-way system which is capable of two-way communications 
between set top terminals on the cable network and the equipment in the cable head-end. 
For example, communications may be transmitted fi"om the terminals to the head-end via 
a back-channel, and content may be transmitted fi-om the head-end to the terminals by 

25 insertion into a transport stream. 

Figure 9 depicts an example of one frame taken from a video sequence of 
an IPG page in accordance with the present invention. The IPG page 900 of Figure 9 
comprises a first 905 A, second 905B and third 905C time slot objects, a plurality of 
channel content objects 910-1 through 910-8, a pair of channel indicator icons 941 A, 
30 94 IB, a video barker 920 (and associated audio barker), a cable system or provider logo 
915, a program description region 950, a day of the week identification object 931, a time 



22 




of day object 939, a next time slot icon 934, a temporal increment/decrement object 932, 
a "favorites" filter object 935, a "movies" filter object 936, a "kids" (i.e., juvenile) 
programming filter icon 937, a "sports" programming filter object 938 and a VOD 
programming icon 933. It should be noted that the day of the week object 93 1 and next 
5 time slot icon 934 may comprise independent objects (as depicted in Figure 9) or may be 
considered together as parts of a combined object. 

In a system, illustratively, comprising 80 channels of information, the 
channels are displayed in 8-channel groups having associated with them three hour time 
slots. In this organization, it is necessary to provide 10 video PIDs to carry the present- 

10 time channel/time/title information, one or more audio PBD to carry the audio barker 
and/or one or more data FED (or other data transport method) to carry the program 
description data, overlay data and the like. To ftilly broadcast interactive program 
information up to 24 hours in advance, it is necessary to provide 160 (10*24/1.5) video 
PIDS, along with one or more audio and, optionally, one or more data PIDs. The amount 

15 of time provided for in broadcast video PIDs for the given channel groups comprises the 
time depth of the program guide, while the number of channels available through the 
guide (compared to the number of channels in the system) provides the channel depth of 
the program guide. In a system providing only half of the available channels via 
broadcast video PIDs, the channel depth is said to be 50%. In a system providing 12 

20 hours of time slot "look-ahead," the time depth is said to be 12 hours. In a system 

providing 16 hours of time slot "look-ahead" and 4 hours of time slot "look-back," the 
time depth is said to be +16/-4 hours. 

The video streams representing the IPG are carried in a single transport 
stream or multiple transport streams, within the form of a single or multi-programs as 

25 discussed previously in this invention. A user desiring to view the next 1 .5 hour time 
interval (e.g., 9:30 - 1 1:00) may activate a "scroll right" object (or move the joystick to 
the right when a program within program grid 902 occupies the final displayed time 
interval). Such activation results in the controller of the STT noting that a new time 
interval is desired. The video stream corresponding to the new time interval is then 

30 decoded and displayed. If the corresponding video stream is within the same transport 
stream (i.e., a new PED), then the stream is immediately decoded and presented. If the 
corresponding video stream is within a different transport stream, then the related 
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transport stream is extracted from the broadcast stream and the related video stream is 
decoded and presented. If the corresponding transport stream is within a different 
broadcast stream, then the related broadcast stream is timed, the corresponding transport 
stream is extracted, and the desired video stream is decoded and presented. 

5 A user interaction resulting in a prior time interval or a different set of 

channels results in the retrieval and presentation of a related video stream. If the related 
video stream is not part of the broadcast video streams, then a pointcast session, for 
example, may be initiated as described above in relation to Figs. 4A and 4B. For this 
purpose, the STT sends a request to the head end via the back channel requesting a 

10 particular stream. The head end then processes the request, retrieves the related stream 
from the information server, incorporates the stream within a transport stream as a video 
PID (preferably, the transport stream currently being tuned/selected by the STT) and 
informs the STT which PID should be received, and from which transport stream it 
should be demultiplexed. The STT then retrieves the related video PID. In the case of 

1 5 the video PID being within a different transport stream, the STT first demultiplexes the 
corresponding transport stream (possibly tuning a different QAM stream within the 
forward channel). 

Normally, upon completion of the viewing of the desired stream, the STT 
indicates to the head end that it no longer needs the stream, whereupon the head end tears 

20 down the pointcast session. The viewer is then returned to the broadcast stream from 
which the pointcast session was launched. However, as described above in relation to 
Figs. 6A, 6B, and 6C, the method for "sharing" pointcasts may avoid the need to tear 
down the pointcast session if another STT is still utilizing the pointcast. In addition, the 
above described pointcast sharing technique more efficiently utilizes the network 

25 bandwidth allocated to pointcasts. 

Now consider the difference in latencies between push demand-casts and 
pull demand-casts. Access to IPG pages with low latency is a desirable feature in 
providing a program guide. A system which only pushes IPG pages would offer 
potentially the lowest latency access, whereas a system which only pulls pages would 
30 incur significant delays in accessing each page. 
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In accordance with a preferred embodiment of the present invention, 
frequently accessed IPG pages such as those in the current time slot and near look-ahead 
time slots, and perhaps prime-time slots would be push demand-cast constantly so as to 
remain accessible with low latency. Less frequently accessed far look-ahead pages would 
5 be pull demand-cast. 

VI. EXAMPLE IMPLEMENTATIONAL ARCHITECTURES 

The first through fourth (1000 through 1300) implementational 
architectures described below are illustrative implementational architectures which may 
be used to implement the present invention. They are not meant to limit the present 
10 invention to those specific embodiments. 

Figure 1000 depicts a first implementational architecture 1000 for 
managing delivery of video sequences of an interactive program guide in accordance with 
an embodiment of the present invention. The first implementational architecture 1000 
includes a key manager 1002, a subscription/billing manager 1004, an IPG generator 
15 1006, and a head-end 102. This first architecture 1000 provides for encryption of the IPG 
content. 

The head-end 102 is coupled to a multitude of STTs 108 by way of both an 
in-band network and an out-of-band (OOB) network. The head-end 102 includes various 
components which are coupled together and interact with each other. The head-end 102 
20 illustrated includes an advertising/html content source 1008, an IPG content source 1009, 
a compositor 1010, an encoder 1012, a processor 1014, a multiplexor 1016, an encryptor 
1018, an in-band delivery system 1020, a controller 1022, a session manager 1024, an 
access manager 1026, a bandwidth manager 1028, and out-of-band (OOB) equipment 
1030. 

25 Note that the session manager 702 of Fig. 7 encompasses the fimctionality 

of multiple components of Fig. 10, including the session manager 1024 and the 
bandwidth manager 1028. Also, note that the transport stream generator 704 of Fig. 7 
encompasses the fimctionality of multiple components of Fig. 10, including the processor 
1014 and the mux 1016. 
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Figure 1 1 depicts a second implementational architecture 1 100 for 



managing delivery of video sequences of an interactive program guide in accordance with 
an embodiment of the present invention. The second implementational architecture 11 00 
includes the components of the first implementational architecture 1000, In addition, the 
5 second implementational architecture 1 100 includes local neighborhood equipment 104 
and a video-on-demand (VOD) server 1 102. This second architecture 1 100 provides for 
encryption of the IPG content. 



an OOB messaging system. The LNE 104 is also coupled to a multitude of STTs 108 by 
10 way of a local in-band network. The LNE 104 includes various components which are 
coupled together and interact with each other. The type of components in the LNE 1 04 
are typically a subset of the type of components in the HE 102. The LNE 104 illustrated 
includes a processor 1 1 14, a multiplexor 1 1 16, an encryptor 1 1 18, a local delivery system 
1 120, a controller 1 122, a session manager (SM) 1 124, an access manager (AM) 1 126, 
1 5 and a bandwidth manager (B WM) 1128. 



delivery of video sequences of an interactive program guide in accordance with an 
embodiment of the present invention. The implementational architecture 1200 includes a 
local IPG center 1202, a headend 1204, a service center 1206, and a plurahty of set- top 
20 terminals (STT) 1208. In addition, the system may be integrated with a video on-demand 
(VOD) system 1210 and a corresponding VOD application 1238 at the STT 1208. This 
third architecture 1200 does not provide for encryption of the IPG content. 



and periodically sends the UI screens to an IPG server 1212 at the headend 1204. 
25 MSO/third party IPG add-on content 1214 may be provided to the IPG server 1212 from 
MSO equipment within the headend 1204. For example, the add-on content may include 
real-time advertisement video or HTML pages for electronic commerce. 

The IPG server 1212 composes (C), encodes (E), processes (P), 
multiplexes (M), and modulates (QAM) the IPG content (guide plus add-on content) and 
30 transmits it to a combiner 1216. The combiner 1216 combines the IPG content with 

broadcast TV, premium content (e.g., HBO), pay-per-view (PPV), and other content from 



The LNE 104 is coupled to the HE 102 by way of an in-band network and 



Figure 12 depicts a third implementational architecture 1200 for managing 



The local IPG center 1202 generates guide page user interface (UI) screens 
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a multiple service operator (MSO) content delivery system 1218. The combined content 
is then broadcast to the STTs 1208 via an in-band distribution network 1220. 

Upon viev^er tuning of the STT 1208 to the IPG channel, an IPG 
application 1222 at the STT 1208 processes the IPG stream and provides the IPG via an 
5 application programming interface (API) 1224 to a "native" application 1226 running on 
the STT 1208. The native application 1226 decodes and presents the IPG to the viewer. 

In one embodiment; the TV program guide for a current time period (1.5 
hours) is broadcast to viewers. In addition, two weeks of lookahead TV programming 
may be delivered to viewers on demand via demand-cast. Upon a view action of moving 
10 a cursor to a lookahead time interval, the STT 1208 sends a request via a backchannel to a 
session manager (SM) 1228 [for example, via an OOB channel to a reverse path 
demodulator (RPD), then to a network controller (NC), then to the SM 1228]. The SM 
1228 then causes the IPG server 1212 to multiplex the requested IPG page into the IPG 
stream. 

15 The SM 1228 also interacts with a subscription/billing interface 1230 in 

the VOD system 1210 to coordinate access to VOD services from a link in the IPG user 
interface (UI). The UI also provides for access to premium content and pay-per-view 
purchasing by interacting through a two-way interface to a MSO customer management 
system (CMS) 1232 and digital access controller (DAC) 1234 in the service center 1206. 

20 The DAC 1234 generates digital encryption-related keys. 

The implementational architecture 1 200 also includes a bandwidth 
manager (BWM) 1236. As described above, the BWM 1236 provides techniques for 
more efficient utilization of the finite bandwidth available for distribution of the IPG. 

Note that the session manager 702 of Fig. 7 encompasses the fimctionality 
25 of multiple components of Fig. 12, including the session manager 1228 and the 

bandwidth manager 1236. Also, note that the transport stream generator 704 of Fig. 7 
encompasses the fimctionality of multiple components of Fig. 12, including the processor 
(P) and the multiplexer (M). 

Figure 13 depicts a fourth implementational architecture 1300 for 
30 managing delivery of video sequences of an interactive program guide in accordance with 
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an embodiment of the present invention. The implementational architecture 1300 of Fig. 
13 has many similarities to the implementational architecture 1200 of Fig. 12. This fourth 
architecture 1300 does not provide for encryption of the IPG content. 

The fourth implementational architecture 1300 differs from the third 
5 implementational architecture 1200 primarily in that some of the equipment is distributed 
from the headend 1204 to a plurality of hubs 1302 in the distribution system. In 
particular, the combiner 1216 is moved from the headend 1204 to each of the hubs 1302. 
In addition, the processor (P), multiplexer (M), and modulator (QAM) are moved from 
the headend 1204 to each of the hubs 1302. Thus, the fiinctionahty of the TSG 704 is 
1 0 transferred to the hubs 1 302. 

VII. MESSAGING PROTOCOL 

Returning attention to the system 700 of Fig. 7, the following describes a 
messaging protocol for communicating between the major components of the system 700. 
The messaging protocol is described in relation to Figs. 14-17. Although a specific 
15 messaging protocol is described below, the present invention is not meant to be limited to 
that specific protocol. 

First, the "source" transport stream generator (TSG) 704 communicates to 
a terminal 706 via, for example, a one-way in-band channel. The communication may be, 
for example, in the form of a "demand-cast index table" within a private section of the 
20 IPG MPEG transport stream. Fig. 14 depicts an embodiment for the content of the 

demand-cast index table. The content may include: (a) a table version number (which 
increments when the table content changes); (b) a list of available demand-cast streams; 
(c) an internet protocol (IP) address for the source TSG; (d) a MUX channel number 
within the source TSG, and (e) a time of day and day of week. 

25 Second, the terminal 706 communicates with the session manager (SM) 

702 via, for example, a one-way out-of-band retum path. The return path may be 
implemented, for example, using a user datagram protocoL/intemet protocol (UDP/IP) 
service to connect the terminal 706 to a network controller (NC) at the SM 702. Fig. 15 
depicts one embodiment for the contents of the messages sent from the terminal 706 to 

30 the SM 702. The message content as shown includes: (a) a demand-cast stream 

identification; (b) the terminal's identification; (c) the IP address of the source TSG; (d) 
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the MUX channel number within the source TSG; and (e) the message information itself. 
The message information may indicate: (1) an acquisition of the demand-cast stream by 
the terminal 706; (2) a release of the demand-cast stream by the terminal 706; or (3) a 
request for the demand-cast stream by the terminal 706. 

5 Third, the SM 702 communicates with the source TSG 704 via, for 

example, a two-way communications channel. The two-way communications channel 
may comprise, for example, a TCP/IP connection over an Ethernet network. Fig. 16 
depicts one embodiment for the contents of the messages sent from the SM 702 to the 
TSG 704. The message content as shown includes: (a) the demand-cast stream 
10 identification; (b) the MUX channel number within the source TSG; and (c) a 

message/command from a set of messages/commands. The set of messages/commands 
include: (1) demand-cast stream released (no longer acquired by any terminal); (2) 
demand-cast stream requested; and (3) a reset command. 

Messages from the SM 702 to the TSG 704 may be acknowledged by the 
15 TSG 704. Fig. 17 depicts one embodiment for the contents of the acknowledgement 
messages sent by the TSG 704 back to the SM 702. An acknowledgement message as 
shown includes: (a) the demand-cast stream ID; (b) the MUX chaimel number; (c) the 
TSG's address; and (d) the acknowledgement itself. The acknowledgement may convey 
acknowledgement of : (1) release of the demand-cast stream; (2) request for the demand- 
20 cast stream; or (3) reset of the TSG 704. 

VIII. STREAM STATUS AND CONVERSIONS OF STATUS 

The following relate to stream status and conversions of status in 
accordance with a preferred embodiment of the present invention. Although a specific 
embodiment of stream status and conversions of status is described below, the present 
25 invention is not meant to be limited to that specific embodiment. 

1. Stream Status Within IPG Multiplex 

The TSG 704 models bandwidth usage for each IGP multiplexed transport 
stream that it is managing. Each demand-cast stream within each transport stream may be 
either active or inactive. Active streams are currently being multiplexed into the transport 
30 stream. Inactive streams are not currently being multiplexed into the transport stream. 
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Figure 1 8 depicts an example showing statuses of active demand-cast 
streams in an IPG multiplex within a TSG 704. For each demand-cast stream, TSG 
assigns status with respect to the streams intended multiplex. Demand-cast stream status, 
in context of the TSG, are: 

5 1) 'active' streams are in the IPG multiplex 

1.1) 'acquired' demand-cast streams are in the multiplex and are used by at 
least one STT. They are referenced in the demand-cast index table in the 
private section of the IPG transport stream. They are not candidates for 
removal. 

10 1.2) 'released' demand-cast streams are in the multiplex and are not used by 

any STT. They are referenced in the demand-cast index table. They can 
become 'passive.' 

1.2.1) 'passive' demand-cast streams are also technically 'released'. 
They are in the multiplex and are not used by any STT. They are 
15 not referenced in the demand-cast index table. They are typically a 

small fraction of the 'released' demand-cast streams. The oldest 
few 'released' demand-cast streams are forced to 'inactive' status 
by a maintenance thread. They are candidates for removal. 

2) 'inactive' demand-cast streams are not in the IPG multiplex. They are not 
20 referenced in the demand-cast index table. They may be inserted in the multiplex. 

Note that the TSG may remove all the 'passive' demand-cast streams from 
their respective IPG multiplexes and replace them with null packets. It is however 
advantageous to leave 'passive' demand-cast streams in the multiplex because if a STT 
attempts to acquire it, latency will be minimized. 

25 2. Conversions of Status 

The TSG receives messages from the SM. Messages received from the SM are: 
1) "request demand-cast stream" 
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2) "release demand-cast stream" The "release demand-cast stream" message 
includes the maximum number of STTs that were registered to the demand-cast 
stream. 

3) "reset" 

1) TSG Request Demand-cast Stream 

a) If the TSG receives a "request demand-cast stream" message from the SM, then the 
following scenarios for activating the stream are possible. Figure 1 9 illustrates the 
various scenarios for activation of a demand-cast stream. 

i) If the demand-cast stream is currently 'inactive', then 

In a first case, if there is a 'passive' demand-cast stream in the 
corresponding multiplex, then the TSG removes an 'passive' demand-cast 
stream from its corresponding multiplex, thereby making it 'passive' and 
replaces it with the new requested demand-cast stream. The TSG adds 
reference to the new 'active' demand-cast stream in the demand-cast index 
table. The TSG assigns the status 'active' to the newly inserted demand- 
cast stream. The TSG acknowledges SM for the "request demand-cast 
stream" message by sending a "success" message back to the SM. 

In a second case, if there are no 'passive' demand-cast streams in the 
corresponding multiplex, but there is a 'released' demand-cast stream 
therein, then the TSG forces the oldest 'released' demand-cast stream to 
'inactive' status and then follows the steps described directly above. 

Finally, in a third case, if the TSG finds no 'passive' or 'released' demand- 
cast stream in the corresponding multiplex, it can not fulfill the request. It 
acknowledges the SM for the "request demand-cast stream" message by 
sending a "fail" message back to the SM. 

ii) If the demand-cast stream is currently 'released' or 'passive', then 
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The TSG changes the status of the 'released' or 'passive' demand-cast 
stream to 'acquired.' It acknowledges the SM for the "request demand- 
cast stream" message by sending a "success" message back to the SM. 

2) TSG Release Demand-cast Stream 

5 If the TSG receives a "release demand-cast stream" message from the SM, 

then the TSG acknowledges the SM by sending a "success" message. If the demand-cast 
stream is currently 'acquired', then the TSG changes the status of the stream to 'released.' 

3^ Released Stream to Passive Stream Conversion 

Removal of a 'released' demand-cast streams could be done, however, 
10 such removal would be disadvantageous. Initially, the reference to the 'released' 

demand-cast stream would have to be removed from the "demand-cast index table", then 
a few seconds later, the stream could be physically removed from the multiplex. This 
delay between removal from the table and from the multiplex is necessary to prevent a 
race condition where a STT is acquiring a demand-cast stream while the TSG is in the 
15 process of removing it. Therefore, only 'passive' streams are removed in accordance 
with a preferred embodiment of the present invention. 

The ratio of 'passive' to 'released' demand-cast may be specified in the 
TSG configuration file. It may be maintained as a percentage (i.e. 10% of 'released' 
streams are converted to 'passive') or it can be maintained as an absolute number (i.e. so 
20 as to ensure that there are usually two or three 'inactive' demand-cast streams). 

Figure 20 illustrates an overall process by which a released stream may be 
converted to a passive stream. Methods for determining which released streams are 
converted to passive streams include: an aging method and a statistical method. In the 
aging method, the oldest few 'released' demand-cast streams are constantly converted to 
25 'passive' status by a maintenance thread. In the statistical method, the "release demand- 
cast stream" messages include statistical data regarding the demand-cast stream. This 
data is the maximum number of STTs that were on a released stream before it was 
released. The TSG converts those demand-cast streams that have had the least amount of 
users to 'passive' status. 
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VIII. OTHER TECHNICAL ASPECTS 

The following are further technical aspects in accordance with a preferred 
embodiment of the present invention. Although a specific embodiment of those aspects is 
described below, the present invention is not meant to be limited to that specific 
5 embodiment. 

1. Initial Conditions 

A. STT 

When the STT launches the IPG application, it tunes to the QAM carrying 
the IPG transport stream. When the STT requests its first demand-cast stream it opens the 
10 IPG channel with the SM. When the QAM is tuned, the STT acquires the demand-cast 
index table and sends an Init command to SM. 

B. SM 

Initially the SM knows nothing about the IPG multiplex fed to its client 
STTs. Upon receiving a first "request demand-cast stream" message from a STT, it 
15 verifies that it is aware of the mux ID. Mux ID includes TSG IP address and mux channel 
within the TSG. It it is aware, then nothing happens. If it is not aware, the TSG opens a 
communication socket with the source TSG. The SM maintains a log where it registers 
all muxes that it controls. For each mux in the log, the TSG IP address and mux channel 
number is recorded. 

20 C. TSG 

Initially, the TSG is configured through its own configuration file. 
Configuration includes the number of demand-cast streams that can be supported by each 
IPG mux. The absolute number of 'passive' streams or the ratio of 'passive' streams to 
'released' streams is specified in the configuration file. 
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2. Reset 
A, SM 

If the SM is down, upon reset, it looks-up TSG log file and sends a reset 
command to the TSG. 

5 B. TSG 

When TSG receives a "reset" command from the SM, it removes reference 
to all demand-cast streams in the demand-cast index table in the multiplex referenced by 
the mux ID in the reset command. Then a few second later, the TSG removes all the 
demand-cast streams within the multiplex. 

10 C. STT 

When the STT does not "see" the PID of the demand-cast stream it is 
acquiring in the demand-cast index table, it acquires a default IPG broadcast PID. If the 
STT does not see the demand-cast index table, the STT exits the IPG application. 

3* Scalability 

15 A. TSG 

Each TSG can manage more than one IPG multiplex. IPG multiplex is 
referred to by the IPG address of the host TSG and the mux channel number on the TSG. 

SM 

SM can manage more than one TSG. Each IPG multiplex is referred to by 
20 the IPG address of the host TSG and the mux channel number on the TSG. 

C. STT 

STT messages regarding demand-cast streams include demand-cast stream 
ID, TSG IP address and the mux channel number on the TSG. 

While specific embodiments and applications of the present invention have 
25 been illustrated and described, it is to be imderstood that the invention is not limited to the 
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precise configuration and components disclosed herein and that various modifications and 
variations which will be apparent to those skilled in the art may be made in the 
arrangement, operation, and details of the method and apparatus of the present invention 
disclosed herein without departing from the spirit and scope of the invention as defined in 
the following claims. 
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